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PERFORMANCE LEVEL SETTING OF A DATA PROCESSING SYSTEM 

This invention relates to the field of data processing systems. More 
particularly, this invention relates to performance-level setting in data processing 
5 systems in which the processor is settable to a plurality of different processor 
performance levels. 



An important objective of processor design is to provide improved 
performance and yet to reduce power consumption. Some modern processors offer 

10 the ability to set the processor to one of a number of different processor performance 
levels, depending on the requirements of the program application(s) at the time. Such 
processors take advantage of the fact that reducing the clock frequency and the 
corresponding operating voltage of the processor can potentially yield a quadratic 
decrease in energy consumption. However, processor performance reduction is only 

15 acceptable if there is little or no performance impact perceived by the user. 
Accordingly, it is important that reduction in the processor performance level should 
not result in the software missing its execution deadlines. Completing a given 
processing task before its deadline and then idling is less energy efficient than running 
the task more slowly thereby ensuring that it meets its deadline more exactly. 

20 

Known performance-level setting techniques include so-called interval-based 
algorithms, the main ideas of which are described in Weiser et. al., "Scheduling for 
Reduced CPU Energy", Proceedings of First Symposium of Operating systems Design 
and Implementation, November 1994. Such known interval-based algorithms monitor 

25 the processor utilisation history and derive an indication of an appropriate 
performance-level by calculating the ratio of idle time to busy time in a fixed, short 
(10 to 50 milliseconds) time window. Typically the global processor utilisation in the 
most recent time interval is calculated and if it is above a threshold value the 
processor performance-level is increased whereas if the time interval includes mostly 

30 idle time, the performance-level is reduced. Although such known techniques work 
reasonably well for regular workloads, they perform poorly for irregular (i.e. non- 
periodic) workloads and for interactive applications. Other known techniques use a 
weighted average of global utilisation of the processor as a guide to future utilisation. 
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However it has been shown (see Grunwald et. al. "Policies for Dynamic Clock 
Scheduling", Proceedings of the Fourth Symposium of Operating systems Design and 
Implementation, October 2000) that this alternative technique does not yield a clock 
speed that would significantly improve processor utilisation and decrease idle time. 

Accordingly there is a need for a performance-level setting technique that can 
more accurately predict an appropriate processor performance-level for a diverse 
range of workloads, for example, including irregular workloads and interactive 
workloads. 

The present invention provides a method of calculating a target processor 
performance level from a utilisation history of said processor in performance of a 
plurality of processing tasks, said method comprising: 

calculating a task work value indicating processor utilisation in performing a 
given processing task within a corresponding task time-interval; 

calculating said target processor performance level in dependence upon said 
task work value. 

The invention recognises that individual processing tasks (or groups of 
processing tasks) often have discernible utilisation periods at the task level, which can 
be obscured of all tasks are observed in the aggregate when assessing an appropriate 
performance level. By focussing on processor utilisation at the task-level the diversity 
of processing tasks and their associated required performance levels can be better 
accommodated by the performance-setting policy. The invention allows direct 
performance-level predictions to be made for each processing task rather than 
indirectly scaling the processor performance level up and down by an arbitrary amount 
dictated by the global workload. 

The task work value for a single previous time window could be used to 
predict an appropriate future performance level for that processing task. However, 
preferred embodiments combine task work values corresponding to a plurality of 
previous executions of the same processing task in order to predict a future 
performance level. This has the advantage of providing a statistically more accurate 
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performance level prediction with regard to the specific task. 

It will be appreciated that the task time interval could be set to a fixed value 
for each execution of each processing task. However, by independently setting the 
5 task time interval for each processing task the performance prediction system can be 
made more adaptable to different workload types. In particular, whereas a short time- 
period may be appropriate for an interactive processing task, a comparatively longer 
time-period is likely to be more appropriate for a non-interactive task. If an 
inappropriately short task time interval is selected, this can cause oscillations between 

10 performance levels. Allowing the task time interval to be independently set for each 
processing task increases the likelihood that a stable performance prediction will be 
settled upon. Furthermore, by setting the time-period independently for each 
execution of a given processing task, the performance prediction can be adapted to 
take account of other tasks forming part of the workload at the time of execution. 

15 These other co-existing tasks are likely have an impact on total execution time for a 
given task due to task pre-empting. 

The task time-interval could be flexibly defined, provided that the interval 
includes execution of said given processing task somewhere within its range. 

20 However, preferred embodiments define the task time interval such that it begins 
when a first scheduling of the given processing task commences and ends prior to a 
subsequent execution of the given processing task. This has the advantage that it is 
simple to implement and the task time interval is correlated with the frequency of 
execution of the given processing task. This makes the technique more suitable for 

25 and adaptable to non-periodic processing tasks. 

It will be appreciated that task work values for a plurality of previous 
executions of a given processing task could be combined in many different ways to 
predict a future performance level for that task, for example an average or a weighted 
30 average of the task work value could be calculated. It is particularly preferred to 
combine the task work values to compute an exponentially decaying work done value 
since this allows for the most recently calculated task work values to have a greater 
influence on the average. 
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Although execution deadlines could be calculated for groups of related tasks, it 
is preferred to calculate the execution deadlines on a task by task basis since this 
allows processor performance to be more finely tuned. The task work value and the 
detected idle time within the task time interval are preferably used to compute the task 
execution deadline. This provides a more accurate estimate than using the real-time 
taken to complete a previous execution of the task, since the execution deadline can 
be normalised to take account of the prevailing performance level during the task time 
interval. 

Separately keeping track of exponential averages for the task work value and 
the execution deadline for a given processing task has the advantage that the 
performance level predictions can be weighted by the length of the interval over 
which the task work value was measured. This prevents the task work values 
associated with the longest task time intervals from dominating the prediction and 
thus compensates for widely varying window sizes. 

It will be appreciated that the task work value could include only processor 
utilisation in executing the given processing task in the corresponding task time- 
window. However, preferred embodiments detect when the given processing task is 
pre-empted by another different processing task and include the processor utilisation 
for the pre-empting task(s) in the work done value. This has the advantage of tying 
together related tasks and assessing the appropriate performance level accordingly. It 
is expected that in successive executions of a given task, the same other task(s) are 
highly likely to pre-empt that given task. It follows that the task execution deadline 
and the performance level prediction should take these pre-empting tasks into account. 

Although the task time window could be allowed to vary in size in dependence 
upon the execution time and frequency of execution of the given task, it is preferred 
that an upper-threshold is set for the task time window. This has the advantage that it 
prevents long-running processes that have not been pre-empted from continuing to 
execute at an inappropriate performance level. Recalculation of the performance level 
is initiated when the task time window reaches the upper threshold. 
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In preferred embodiments, the performance level setting method is 
implemented in software in the kernel of the operating system. This has the 
advantage that the software it is able to make decisions based on a richer set of run- 
5 time information, which in turn translates into increased accuracy. 

Viewed from a further aspect the invention provides a method of calculating a 
target processor performance level of a processor from a utilisation history of said 
processor in performance of a plurality of processing tasks, said method comprising 
10 the steps of: 

calculating a task work value indicating processor utilisation in performing a 
given processing task within a predetermined task time-interval; and 

calculating said target processor performance level in dependence upon said 
task work value. 

15 

Viewed from a further aspect the invention provides a computer program 
product bearing a computer program for controlling a computer to calculate a target 
processor performance level of a processor from a utilisation history of said processor 
in performance of a plurality of processing tasks, said computer program comprising: 
20 task work value calculating code operable to calculate a task work value 

indicating processor utilisation in performing a given processing task within a 
predetermined task time-interval; and 

target processor performance calculating code operable to calculate said target 
processor performance level in dependence upon said task work value. 

25 

An example of the present invention will now be described, by way of 
example only, with reference to the accompanying drawings in which: 

Figure 1 schematically illustrates how a power management system according 
30 to the present technique may be implemented in a data processing system; 

Figure 2 schematically illustrates three hierarchical layers of the performance 
setting algorithm according to the present technique. 
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Figure 3 illustrates the strategy for setting the processor performance level 
during an interactive episode; 

5 Figure 4 schematically illustrates execution of a workload on the processes and 

calculation of the utilisation-history window for a task A; 

Figure 5 schematically illustrates an implementation of the three-layer 
hierarchical performance policy stack of Figure 2; 

10 

Figure 6 schematically illustrates a work-tracking counter 600 according to the 
present technique; 

Figure 7 schematically illustrates an apparatus that is capable of providing a 
15 number of different fixed performance-levels in dependence upon workload 
characteristics; 

Figure 8 is a table that details simulation measurement results for a 'plaympeg' 
video player playing a variety of MPEG videos; 

20 

Figure 9 is a table that lists processor performance levels statistics during the 
runs of each workload; 

Figure 10 comprises two graphs of results for playback of two different 
25 MPEG movies entitled 'Legendary' (Figure 10A) and 'Danse de Cable' (Figure 10 B); 

Figures 11 A, B and C schematically illustrate the characteristics of two 
different performance-setting policies; 

30 Figures 12 A, B and C schematically illustrate simulation results for different 

performance-setting algorithms tested on interactive workloads; 



Figure 13 schematically illustrates statistics gathered using a time-skew 
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algorithm uses a relatively simple technique for automatically isolating interactive 
episodes. This technique relies on monitoring communication from the X server, 
which is the GUI controller, and tracking the execution of the tasks that get triggered 
as a result. 

The beginning of an interactive episode (which typically comprises a 
multiplicity of tasks) is initiated by the user and is signified by a GUI event, such as 
pressing a mouse button or a key on the keyboard. As a result this event, the GUI 
controller (X server in this case) dispatches a message to the task that is responsible 
for handling the event. By monitoring the appropriate system calls (various versions 
of read, write, and select), the intelligent energy manager 120 can automatically detect 
the beginning of an interactive episode. When the episode starts, both the GUI 
controller and the task that is the receiver of the message are marked as being in an 
interactive episode. If tasks of an interactive episode communicate with unmarked 
tasks, then the as yet unmarked tasks are also marked. During this process, the 
intelligent energy manager 120 keeps track of how many of the marked tasks have 
been pre-empted. The end of the episode is reached when the number of pre-empted 
tasks is zero, indicating that all tasks have run to completion. 

Figure 3 illustrates the strategy for setting the processor performance level 
during an interactive episode. The duration of an interactive episode is known to vary 
by several orders of magnitude (from around lO^s up to around 1 second). However a 
transition-start latency or c skip threshold' of 5 milliseconds is set to filter out the 
shortest interactive episodes thereby reducing the number of requested performance- 
level transitions. The sub-millisecond interactive episodes are typically the results of 
echoing key presses to the window or moving the mouse across the screen and 
redrawing small rectangles. The skip threshold is set at Smilliseconds since this 
allows short episodes to be filtered out of the performance indicator predictions 
without adversely impacting the worst case. 

If the interactive episode duration exceeds the skip threshold, then the 
associated performance-level value is included in the overall interactive performance- 
level prediction. The performance factor for the next interactive episode is given by a 
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the executing tasks. It also serves to monitor which system calls are accessed by each 
task and how data flows between the communication structures in the kernel. 

Figure 2 schematically illustrates three hierarchical layers of the performance 
5 setting algorithm according to the present technique. It should be noted that on a given 
processor, the frequency/voltage setting options are typically discrete rather than 
continuous. Accordingly the target processor performance level must be chosen from 
a fixed set of predetermined values. Whereas known techniques of calculating a 
target processor performance level involve use of a single performance-setting 

10 algorithm, the present technique utilises multiple algorithms each of which have 
different characteristics appropriate to different run-time situations. The most 
applicable algorithm to a given processing situation is selected at run-time. The 
policy co-ordinator module 122 co-ordinates the performance setting algorithms and 
by connecting to hooks in the standard kernel 110, provides shared functionality to the 

15 multiple performance setting algorithms. The results of the multiple performance- 
setting algorithms are collated and analysed to determine a global estimate for a target 
processor performance level. The various algorithms are organised into a decision 
hierarchy (or algorithm stack) in which the performance level indicators output by 
algorithms at upper (more dominant) levels of the hierarchy have the right to override 

20 the performance level indicators output by algorithms at lower (less dominant) levels 
of the hierarchy. The example embodiment of Figure 2 has three hierarchical levels. 
At the uppermost level of the hierarchy there is an interactive application performance 
indicator 210, at the middle level there is an application-specific performance 
indicator 220 and at the lowermost level of the hierarchy there is a task-based 

25 processor utilisation performance indicator 230. 

The interactive application performance indicator 210 calculation is 
perfromed by an algorithm based on that described in Flautner et. Al. "Automatic 
Performance-setting for Dynamic Voltage Scaling", Proceedings of the International 
30 Conference on Mobile Computing and Networking, July 2001. The interactive 

application performance-level prediction algorithm seeks to provide guarantees good 
interactive performance by finding the periods of execution that directly impact the 
user experience and ensuring that these episodes complete without undue delay. The 
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An example of a task deadline for a task that produces data is the point at which the 
produced data is required by another task. The deadline for an interactive task would 
be the perception threshold of the user (50 -100 ms). Going at full performance and 
then idling is less energy-efficient than completing the task more slowly so that the 
deadline is met more exactly. When the processor frequency is reduced, the voltage 
may be scaled down in order to achieve energy savings. For processors implemented 
in complementary metal-oxide semiconductor (CMOS) technology the energy used 
for a given workload is proportional to the voltage squared. The policy co-ordinator 
manages multiple performance-setting algorithms, each being appropriate to different 
run-time situations. The most suitable performance-setting algorithm to a given 
condition is selected at run-time. The performance setting control module 124 
receives the results of each performance-setting algorithm and repeatedly calculates a 
target processor performance by prioritising these results. The event tracing module 
126 monitors system events both in the kernel 110 and in the user process layer 130 
and feeds the information gathered to the performance setting control module 124 and 
the policy co-ordinator 122. 

In the user processes layer, processing work is monitored via: system call 
events 132; processing task events 134 including task switching, task creation and 
task exit events; and via application-specific data. The intelligent energy manager 
120 is implemented as a set of kernel modules and patches that hook into the standard 
kernel functional modules and serve to control the speed and voltage levels of the 
processor. The way in which the intelligent energy manager 120 is implemented 
makes it relatively autonomous from other modules in the kernel 100. This has the 
advantage of making the performance setting control mechanism less intrusive to the 
host operating system. Implementation in the kernel also means that user application 
programs need not be modified. Accordingly, the intelligent energy manager 120 co- 
exists with the system calls module 112, the scheduler 114 and the conventional 
power manager 116 of the kernel, although it may require certain hooks within these 
sub-systems. The intelligent energy manager 120 is used to derive task deadlines and 
task classification information (e.g. whether the task associated with an interactive 
application) from the OS kernel by examining the communication patterns between 



DYC »ef: P15674GBZ 
AR -f: P263 



7 



correction technique. 

Figure 1 schematically illustrates how the power management system may be 
implemented in a data processing system. The data processing system comprises a 
kernel 100 having standard kernel functional modules including a system calls module 
112, a scheduler 114 and a conventional power manager 116. An intelligent energy 
manager system 120 is implemented in the kernel and comprises a policy co-ordinator 
122, a performance setting control module 124 and an event-tracing module 126. A 
user processes layer 130 comprises a system calls module 132, a task management 
module 134 and application specific data 136. The user processes layer 130 supplies 
information to the kernel 100 via an application-monitoring module 140. 

The kernel 100 is the core that provides basic services for other parts of the 
operating system. The kernel can be contrasted with the shell, which is the outermost 
part of the operating system that interacts with user commands. The code of the 
kernel is executed with complete access privileges for physical resources, such as 
memory, on its host system. The services of the kernel are requested by other parts of 
the system or by an application program through a set of program interfaces known as 
system call. Both the user process layer and the kernel have system calls modules 
1 12, 132. The scheduler 1 14 determines which programs share the kernel's processing 
time and in what order. A supervisor (not shown) within the kernel gives use of the 
processor to each process at the scheduled time. The conventional power manager 
116 manages the supply voltage by switching the processor between a power- 
conserving sleep mode and a standard awake-mode in dependence upon the level of 
processor utilisation. 

The intelligent energy manager 120 is responsible for calculating and setting 
processor performance targets. Rather than relying only on sleep mode for power 
conservation, the intelligent energy manager 120 allows the central processing unit 
(CPU) operating voltage and the processor clock frequency to be reduced without 
causing the application software to miss process (i.e. task) deadlines. When the CPU 
is running at full capacity many processing tasks will be completed in advance of their 
deadlines whereupon the processor will idle until the next scheduled task is begun. 
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ighted exponentially decaying average of calculated performance factors for all past 
interactive episodes. Note that according to the present technique the interactive 
application performance setting algorithm uses a single global prediction for the 
necessary performance level for an interactive episode in the system. [This differs 
from the technique described in the above-mentioned publication, according to which 
a per-task performance-level prediction was used depending on which task initiated 
the episode.] 

To bound the worst-case impact of an erroneous performance-level prediction 
on the user experience, if the interactive episode does not finish before reaching a so- 
called 'panic threshold', then the performance-level prediction of the top hierarchical 
layer is specified to be the maximum performance level. Since this is a top-level 
prediction it will be enforced by the system. At the end of the offending interactive 
episode, the interactive algorithm computes what the correct performance-setting for 
the episode should have been and this corrected value is incorporated into the 
exponentially decaying average so that it will influence future predictions. An 
additional optimisation is performed such that that if the panic threshold was in fact 
reached during an interactive episode, the moving average is re-scaled so that the 
corrected performance level is incorporated in the exponentially decaying average 
with a higher weight (k=l is used instead of k=3). The performance prediction is 
computed for all episodes that are longer than the skip threshold. 

Interactive episode 'deadlines' are used to obtain a performance-level indicator 
for each identified interactive episode. The deadline is the latest time by which a task 
must be completed to avoid adversely impacting performance. The performance level 
indicator for interactive episodes is calculated in dependence upon the human 
perception threshold associated with the particular interactive event. For example, it 
is known that a rate of 20 to 30 frames per second is fast enough for the user to 
perceive a series of images as a continuous stream so that the perception threshold 
could be set to 50ms for an interactive image display episode. Although the exact 
value of the perception threshold is dependent on the user and the type of task being 
accomplished, a fixed value of 50ms was found to be adequate for the interactive 
algorithm of the hierarchy. The equation below is used for computing the 
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performance requirements of episodes that are shorter than the perception threshold. 

Work M 

Perf = — 

Perception Threshold 

where the full-speed equivalent work Work fse is measured from the beginning 
of the interactive episode. 

5 

The application-specific performance indicator 220 of the middle hierarchical 
layer is obtained by collating information output by a category of application 
programs that are aware of performance level setting functionality. These program 
applications have been adapted to submit (via system calls) specific information to the 
10 intelligent energy manager 120 about their specific performance requirements. The 
operating system and application programs can be provided with new API elements to 
facilitate this communication regarding performance requirements. 

The perspectives-based performance indicator 230 is obtained by 

15 implementing a perspectives based algorithm that estimates future utilisation of the 
processor based on the recent utilisation history. This algorithm derives a utilisation 
estimate for each individual task and adjusts the size of a the time period over which 
the utilisation-history is calculated (i.e. the utilisation-history window) on a task by 
task basis. The perspectives-based algorithm takes account of all categories of task 

20 being performed by the processor whereas the interactive application algorithm of the 
uppermost layer takes account of interactive tasks. Since the interactive application 
algorithm calculates a performance-level indicator that aims to guarantee a high 
quality of interactive performance and it is situated at the uppermost level of the 
hierarchy, the perspectives-based algorithm need not be constrained to a 

25 conservatively short utilisation-history window. The possibility of using longer 
utilisation-history windows at this lowermost hierarchical level allows for improved 
efficiency since a more aggressive power reduction strategy can be selected when 
appropriate. If the utilisation-history window is too short, this can cause the 
performance-level predictions to oscillate rapidly between two fixed values. It is 

30 typically necessary to set a short utilisation history window where a single unified 
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algorithm (rather than a hierarchical set of algorithms) is used to set the performance 
level for all run-time circumstances. To be able to cope with intermittent processor- 
intensive interactive events, such unified algorithms must keep the utilisation-history 
window short. 

5 

Each of the performance-setting algorithms of the 3 -layer stack uses a measure 
of processing work-done in a given time interval. In this embodiment, the work-done 
measure that is used is the full-speed (of the processor) equivalent work Work fse 
performed in that time interval. This full-speed equivalent work estimate is calculated 
10 according to the following formula: 

n 

Work p, 

1=1 

where i is one of n different processor performance levels implemented during 
the given time interval; t\ is the non-idle time in seconds spent at performance level i; 
and pi is the processor performance level i expressed as a fraction of the peak (full- 

15 speed) processor performance level. This equation is valid on a system in which a 
time-stamp counter (work counter) measures real time. The work-done would be 
calculated differently in alternative embodiments that use cycle counters whose count 
rate varies according to the current processor frequency. Furthermore, the above 
equation makes the implicit assumption that the run-time of a workload is inversely 

20 proportional to the processor frequency. This assumption provides a reasonable 
estimate of work-done. However, primarily due to the non-linearity of bus speed to 
processor speed ratios during performance scaling, the assumption is not always 
accurate. In alternative embodiments the work-done calculation can be fine-tuned to 
take account of such factors. 

25 

Figure 4 schematically illustrates execution of a workload on the processor and 
calculation of the utilisation-history window for a task A. The horizontal axis of 
Figure 4 represents time. Task A first starts execution at time S, whereupon a number 
of per-task data structures are initialised. There are four of these data structures 
30 corresponding to the following four pieces of information: (i) the current state of the 
work counter; (ii) the current (real) time; (iii) the current state of an idle-time counter; 
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and (iv) a run bit is set to logical level ' 1 ' indicating that the task has started running. 
The work-counter, the real-time counter and the idle-time counters are used to 
calculate the processor utilisation associated with task A and subsequently to calculate 
task A's performance requirements. At time PE, task A has not yet run to completion 
5 but is pre-empted by another task, task B. Pre-empting will occur when the task 
scheduler 114 determines that another task has higher priority than the task that is 
currently running. When task A is pre-empted the run bit is maintained at logical level 
of c r to indicate that the task still has work to complete. At time RE, task A resumes 
execution, having been rescheduled, and continues to execute until it has run to 
10 completion at time TC whereupon it voluntarily gives up processing time. On 
completion task A may initiate a system call that yields the processor to another task. 
On completion of task A at time TC the run-bit is reset to logical level '0\ 

After time TC, there is an idle period followed by execution of a further task C 
15 and a subsequent idle period. At time RS, task A begins execution for a second time. 
At time RS, the '0' state of the run-bit associated with task A indicates that 
information exists to enable calculation of task A's performance requirements so that 
the processor target performance level can be accordingly set for the imminent re- 
execution of task A. The utilisation-history window for a given task is defined to be 
20 the period of time from the start of the first execution of the given task to the start of 
the subsequent execution of the given task and should include at least one pre-empting 
event (task A is pre-empted by task B at point RE in this case) of the given task within 
the relevant window. Accordingly, in this case the utilisation-history window for task 
A is defined to be the time period from time S to time RS. The target performance 
25 level for task A in this window is calculated as follows: 
WorkEstNew - (k xWorkEstoid+ Workf se ) / (k+1) 

Deadline New = (k x Deadline oid+ (Workj se + Idle))/ (k+1) 

30 where k is a weighting factor, Idle is the idle time in seconds in the time 

interval from time S to time RS in Figure 4 and the deadline for task A is defined to 
be (Workfoe + Idle). In this particular example, performing detection of pre-empting 
tasks such as task B in Figure 4 guides the algorithm in determining the utilisation- 
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history window for each task. Processing tasks that are run before the next non- 
preempted scheduling of task A are often highly correlated with the execution of task 
A. The idle time between time points TC and RS is the "slack" that can be taken up 
by running the processor at a reduced performance level. However, task C is factored 
into the performance level calculation since it diminishes the available slack. 

The above equations for WorkEst New and Deadline^ each represent an 
exponentially decaying average. Such exponentially decaying averages allow for 
more recent estimates to have more influence on the average than less recent 
estimates. The weighting factor k is a parameter associated with the exponentially 
decaying average. It was found that a value of k=3 worked effectively and this small 
value indicates that each estimate is a good estimate. By keeping track of the work 
predictor and the deadline predictor separately, the performance predictions are 
weighted according to the length of the utilisation-history window. This ensures that 
the performance estimates associated with the larger window sizes do not dominate 
the performance prediction. The performance level indicator Perf pers pectives-based for this 
algorithm is given by the ratio of the two exponentially decaying averages: 
PerUspec^ase^ WorkEst New / Deadlines A separate performance level value is 
calculated for each task. According to the strategy of the present technique, the work 
estimates WorkEst for a given task is re-calculated on a workload dependent time- 
interval of between 50 and 150 milliseconds. However, since WorkEst is calculated 
on a task by task basis so that each executed task draws on a respective appropriate 
task-based WorkEst value, the WorkEst is actually refined every 5 to 10 milliseconds 
(reflecting task switching events). This algorithm differs from known interval-based 
algorithms in that it derives an utilisation estimate separately for each task and also 
adjusts the size of the utilisation-history window on a task by task basis. Although 
known unified performance-setting algorithms use exponentially decaying averages, 
they calculate a global average over all performance tasks for a fixed utilisation- 
history window (10 to 50 milliseconds) rather than a task-based average over a 
variable task-based utilisation-history window. 

According to the perspectives-based algorithm of the present technique it is 
necessary to avoid a situation occurring whereby a new non-interactive CPU bound 
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task utilises the processor for an extensive period without being pre-empted. This 
could introduce substantial latency in adaptation of the performance level to the task 
since the utilisation-history window can only be defined once the task has been pre- 
empted at least once. To avoid unwanted performance adaptation latency an upper 
5 threshold is set for the non pre-empted duration over which the work estimate is 
calculated. In particular, if a task continues without being pre-empted for 100 
milliseconds, then its work estimate is recalculated by default. The value of 100 
milliseconds was selected by taking into account that a more stringent application- 
history window is ensured for interactive applications via the dominant hierarchical 

10 layer 210, which produces a separate interactive application performance indicator. It 
was also considered that the only class of user applications likely to be affected by the 
100 millisecond window threshold are computationally intensive batch jobs such as 
compilation, which are likely to run for several seconds or even minutes. In such 
cases an extra 100 milliseconds (0.1 seconds) of run time is unlikely to be significant 

15 performance-wise. 

Figure 5 schematically illustrates an implementation of the three-layer 
hierarchical performance policy stack of Figure 2. The implementation comprises a 
performance indicator policy stack 510 and a policy event handler 530, each of which 

20 outputs information to a target performance calculator 540. The target performance 
calculator 540 serves to collate the results from four performance-setting algorithms: 
top level interactive algorithm, middle level application-based algorithm and two 
different lower level algorithms. The four algorithms are capable of being run 
concurrently. The target performance calculator 540 derives a single global target 

25 performance level from the multiple performance indicators (in this case four) 
produced by the policy stack 510. The policy stack 510 together with the policy event 
handler 530 and the target performance calculator 540 provides a flexible framework 
for multiple performance-setting policies so that policy algorithms of each level of the 
stack can be replaced or interchanged as desired by the user. Accordingly the 

30 performance policy-stack provides a platform for experimentation in which user- 
customised performance-setting policies can be incorporated. 



Each of the multiple performance-setting algorithms is specialised to cope 
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with a different specific category of run-time events. However, since there are four 
different algorithms in the example embodiment of Figure 5, all outputting different 
performance-indicators, the software must make decisions as to, which of the four 
performance-indicators should take precedence in setting the global target value. 
Furthermore, decisions must be made as to the times at which a global target 
performance-level can be validly calculated, given that each performance-setting 
algorithm can run independently and produce output at different times. It must also be 
considered how to combine the performance-indicators in the event that the multiple 
performance-setting algorithms all base their decisions on the same processing event, 
otherwise spurious target updates may occur. 

To address these issues the policy stack 510 algorithms are organised in a 
three-level hierarchy as shown, where policies at higher levels are entitled to override 
performance level requests derived from lower (less dominant) levels. Accordingly, 
the level 2 algorithm can override the level 1 algorithm, which can in turn override the 
two algorithms of level 0. Note that each hierarchical level may itself comprise 
multiple alternative performance-setting algorithms. The different performance- 
setting algorithms are not aware of their positions in the hierarchy and can base their 
performance decisions on any event in the system. When a given algorithm requests a 
performance level it submits a command along with its desired performance level to 
the policy stack 510. For each algorithm of the policy stack a data structure 
comprising a command 512, 516, 520, 524 and a corresponding performance level 
indicator 514, 518, 522 and 526 is stored. The command IGNORE 520 which applies 
to the level 1 algorithm indicates to the target performance calculator 440 that the 
associated performance-level indicator should be disregarded in calculation of the 
global performance target. The command SET 512, 516 that has been specified for 
both of the level 0 algorithms causes the target performance calculator 540 to set the 
corresponding performance level without regard to any performance-level request 
coming from lower in the hierarchy. However the SET command cannot override 
performance level requests from higher hierarchical levels. In this embodiment one 
level 0 algorithm has requested that the performance be set to 55% of peak level 
whereas another level 0 algorithm has requested that the performance be set to 25% of 
peak level. The target performance calculator uses an operator to combine these two 
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equal-priority requests, in this case preferentially selecting the 55% value as the level 
0 performance-indicator. At level 2, the command 'SET IF GREATER THAN' has 
been specified together with a performance indicator of 80%. The 'SET IF 
GREATER THAN' command provides that the target performance calculator 540 
5 should set the global target performance -level to be 80% provided that this is greater 
than any of the performance indicators from lower hierarchical levels. In this case the 
level 0 performance indicator is 55% and the level 1 performance indicator is to be 
disregarded so that the global target will indeed be set to 80% of peak performance. 

10 Since the most recently calculated performance level indicators for each 

algorithm are stored in memory by the policy stack 510, the target performance 
calculator 540 can calculate a new global target value at any time without having to 
invoke each and every performance-setting algorithm. When a new performance level 
request is calculated by one of the algorithms on the stack, the target performance 

15 calculator will evaluate the contents of the command-performance data structures 
from the bottom level up to compute an updated global target performance level. 
Accordingly in the example of Figure 5, at level 0 the global prediction is set to 55%, 
at level 1 it remains at 55% and at level 2 the global prediction changes to 80%. 
Although each of the performance-setting algorithms can be triggered (by a processing 

20 event in the system) to calculate a new performance level at any time there is a set of 
common events to which all of the performance -setting algorithms will tend to 
respond. These events are monitored and flagged by the policy event handler 530, 
which provides policy event information to the target performance calculator 540. 
This special category of events comprises reset events 532, task switch events 534 and 

25 performance change events 536. The performance change event 536, is a notification 
that alerts each performance setting algorithm to the current performance level of the 
processor although it does not usually alter the performance requests on the policy 
stack 510. For this special category of policy events 532, 534, 536, the global target 
level is not recomputed each time one of the algorithms issues an updated 

30 performance-level indicator. Rather, the target performance level calculation is co- 
ordinated so that the calculation is performed once only for each event notification 
after all event handlers of all interested performance setting algorithms have been 
invoked. 
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Device drivers or devices themselves may be provided with an application 
program interface (API) that enables an individual device to inform the policy stack 
510 and/or individual performance setting algorithms of the policy stack of any 
significant change in operating conditions. This allows the performance-setting 
algorithms to trigger recalculation of target performance levels thereby promoting 
rapid adaptation to the change in operating conditions. For example, a notification 
could be sent by the device to the policy stack 510 when a processor-intensive CPU- 
bound task starts up. Such a notification is optional and the performance-setting 
algorithms may but need not respond to it on reception. 

Figure 6 schematically illustrates a work-tracking counter 600 according to the 
present technique. The work-tracking counter 600 comprises: an increment value 
register 610 having a software control module 620 and a hardware control module 
630; an accumulator module 640 comprising a work-count value register and a time - 
count value register; a time-base register 646; a real-time clock 650 and a control 
register 660. The work-tracking counter of this example embodiment differs from 
known timestamp counters and CPU cycle counters in that the counter increment 
values are proportional to the actual work being performed by the processor at or close 
to the time that the count value is incremented. The increment value register 610 
comprises a work-done calculator that estimates the work done by the processor in 
each counter cycle. The work done estimates are obtained via the software control 
module 620 and/or via the hardware control module 630. The software control 
module 620 implements a simple work-done calculation that correlates the increment 
value with the current processor speed. If the processor is running at 70% of peak 
performance then the increment value will be 0.7 whereas if the processor is running 
at 40% of peak-performance the increment value will be 0.4. When the software 
control module 620 detects that the processor is idle during a counter cycle then the 
increment value is set to zero. In alternative embodiments of the work-tracking 
counter a more sophisticated software algorithm is used to calculate a refined work- 
done estimate. 



Table 1 lists measurement data that gives a percentage discrepancy between an 
expected run-time duration and an actual run-time duration for both a CPU bound 
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loop and for an MPEG video workload when considering a performance-level 
transition between two different processor speeds (from a higher to a lower speed in 
this case). The results are based on post-transition runs at three distinct processor 
performance levels: 300, 400, and 500 Mhz (as specified in the left-most column of 
table). The top row of Table 1 lists the initial performance level from which the 
transition to the corresponding processor speed in the left-most column was made. On 
the CPU bound loop, the difference between the predicted and actual measurements 
are indistinguishable from the noise, whereas for the MPEG workload, there is about a 
6%-7% inaccuracy penalty per 100 Mhz step in processor frequency. The maximum 
inaccuracy on these workloads is seen to be less than 20% (19.4%),which is 
considered to be acceptable for a system with only a few fixable performance-levels. 
However as the available range of minimum to maximum processor performance 
levels that are selectable in a system increases and the range of each performance- 
level step decreases, it is likely that a more accurate work- estimator than the 
processor speed will be required. 



Post- 
transition 
speed 


CPU BOUND LOOP 


MPEG VIDEO WOR1 


<XOAD 


400 MHz 


500 MHz 


600 MHz 


400 MHz 


500 MHz 


600 MHz 


300 MHz 


-0.3% 


-0.4% 


-0.3% 


7.1% 


13.5% 


19.4% 


400 MHz 




-0.1% 


0.0% 




6.9% 


13.3% 


500 MHz 






0.1% 






6.8% 



The more sophisticated algorithm of alternative example embodiments uses a 
more accurate work-done estimation technique that involves monitoring the 
instruction profile (via counters that keep track of significant events such as memory 
accesses) and the expected and actual decrease rate of the workload, rather than 
making the assumption that the work-done is directly proportional to the processor 
speed. Further alternative embodiments use cache hit-rates and memory-system 
performance indicators to refine the work-done estimate. Yet further alternative 
example embodiments use software to monitor the percentage of processing time used 
in executing a programming application (equated to useful work-done) relative to the 
percentage of processing time used in performing background operating-system tasks. 



The hardware control module 630 is capable of estimating work-done even 
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during transition periods when the processor is in the process of switching between 
two fixed performance levels. For each processor performance transition there may 
be a pause of around 20 microseconds during which the processor does not issue any 
instructions. This pause is due to the time needed to resynchronise the phase-locked - 
loops to the new target processor frequency. Furthermore, before the processor 
frequency can be changed, the voltage must be stabilised to an appropriate value for 
the new target frequency. Accordingly, there is a transition time of up to 1 
millisecond, during which it can be assumed that the processor is running at the old 
target frequency but energy is being consumed at the new target level (since the 
voltage has been set to the new target level). The frequency may be ramped up in 
several stages via intermediate frequency steps to affect the performance-level change. 
During such transition periods when the frequency of the processor is changing 
dynamically the hardware control module 630 is operable to update the increment 
value register taking account of the dynamic changes of which the software is 
unaware. Although this example embodiment makes use of both hardware and 
software control modules 620, 630 to calculate the work done, alternative example 
embodiments may use only one of these two modules to estimate the work-done. 

The accumulators) module 640 periodically reads the increment value from 
the increment value register 610 and adds the increment value to an accumulated sum 
stored in the work-count value register. The work-count value register increments the 
work-count value every clock-tick. The clock-tick is a time signal derived from the 
real-time clock 650. To measure the work-done during a predetermined time-interval 
the work-count value stored in the accumulator(s) module 640 is read twice: once at 
the beginning of the predetermined time interval and once at the end. The difference 
between these two values provides an indication of the work-done during the 
predetermined time interval. 

The real-time clock 650 also controls the rate at which the time-count value 
stored in the register 644 is incremented. This time-count value register works on the 
same time base as the work-count value but is used to measure time elapsed rather 
than work done. Having both a time counter and a work-done counter facilitates 
performance-setting algorithms. The time-base register 646 is provided for the 
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purpose of multi-platform compatibility and conversion to seconds. It serves to 
specify the time base (frequency) of the two counters 642, 644 so that time can be 
accurately and consistently be i.e. the accumulated value stored in the time count 
value register provides an indication of the time elapsed in milliseconds. The control 
register module 660 comprises a two control registers, one for each counter. A 
counter can be enabled, disabled or reset via the appropriate control register. 

Figure 7 schematically illustrates an apparatus that is capable of providing a 
number of different fixed performance-levels in dependence upon workload 
characteristics. The apparatus comprises a CPU 710, a real-time clock 720, a power 
supply control module 730 and the increment value register 610 of the work-tracking 
counter of Figure 6. The power supply control module 730 determines which of the 
fixed performance-levels the CPU is currently set to run at and selects an appropriate 
clock frequency for the real-time clock 720. The power-supply control module 730 
inputs information on the current processor frequency to the increment value register 
610. Accordingly the value of the increment is proportional to the processor 
frequency, which in turn provides an estimate of useful work-done by the processor. 

Many of the performance-setting algorithms of the policy stack 510 use the 
utilisation history of the processor over a given time interval (window) to estimate the 
appropriate future target speed of the processor. The principal objective of any 
performance-setting policy is to maximise the busy time of the processor in the period 
from the start of execution through to the task deadline by reducing the processor 
frequency and voltage levels an appropriate target performance level. 

To enable the target performance level to be realistically predicted, the 
intelligent energy manager 120 provides an abstraction for tracking the actual work 
done by the processor during a given time interval. This work-done abstraction 
allows performance changes and idle time to be taken into account regardless of the 
specific hardware counter implementations, which can vary between platforms. 
According to the present technique, to obtain a work measurement estimate over a 
time interval, each performance-setting algorithm is allocated a 'work structure' data 
structure. Each algorithm is set up to call a 'work-start function' at the beginning of 
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the time interval and a 'work-stop function' at the end of the given time interval. 
During the work-done measurement, the contents of the work structure are 
automatically updated to specify the proportion of idle time and the proportion of 
utilised processor time weighted by the respective performance levels of the 
processor. The information stored in the work structure is then used to compute the 
full-speed equivalent work value (Work fee ), which is subsequently be used for target 
performance-level prediction. This work-done abstraction functionality, which is 
implemented in software in the intelligent energy manager 120 provides performance- 
level prediction algorithm developers with a convenient interface to the intelligent 
energy manager 120. The work-done abstraction also simplifies porting of the 
performance-setting system of the present technique to different hardware 
architectures. 

One significant difference between alternative hardware platforms is the 
manner in which time is measured on the platform. In particular, some architectures 
provide a low overhead method of cycle-counting via timestamp counters whereas 
other architectures only provide the user with externally programmable timer 
interrupts. However even when timestamp counters are provided they do not 
necessarily measure the same things. For example a first category of hardware 
platforms includes both current Intel [RTM] Pentium and ARM [RTM] processors. In 
these processors the timestamp counters count CPU-cycles so that the count-rate 
varies in accordance with the speed of the processor and the counter stops counting 
when the processor enters into sleep mode. A second category of hardware platforms, 
which includes the Crusoe [RTM] processor, have an implementation of the 
timestamp counter that consistently counts the cycles at the peak rate of the processor 
and continues to increment the count at the peak rate even when the processor is in 
sleep mode. The work-done abstraction facilitates implementation of the present 
target performance-setting technique on both of these two alternative categories of 
hardware platform. 

The work estimate Work fse as calculated in this embodiment does not take 
account of the fact that a given workload running at half of peak performance does not 
necessarily take twice as long to run to completion as it would at the full processor 
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speed. One reason for this counter-intuitive result is that although the processor core 
is slowed down, the memory system is not. As a result, the core to memory 
performance ratio improves in the memory's favour. 

5 Simulations were performed to evaluate the present performance-setting 

technique against a known technique. In particular, the known technique is a 
'LongRun' power manager that is built-into a Transmeta Crusoe processor. The 
Transmeta's Crusoe processor has the LongRun power manager built into the 
processor firmware. LongRun is different from other known power management 

10 techniques in that it avoids the need to modify the operating system in order to effect 
the power management. LongRun uses the historical utilisation of the processor to 
guide clock rate selection: it speeds up the processor if utilisation is high and 
decreases performance if utilisation is low. Unlike on more conventional processors, 
the power management policy can be implemented on the Crusoe processor relatively 

15 easily because the processor already has a hidden software layer that performs 

dynamic binary translation and optimisations. The simulations aimed to establish how 
effectively a policy such as LongRun that is implemented at such a low level in the 
software hierarchy can perform. The present technique was run alongside LongRun on 
the same processor. 

20 

The simulations were performed on a Sony Vaio [RTM] PCG-C1 VN 
notebook computer using the Transmeta Crusoe 5600 processor running at a number 
of fixed performance levels ranging from 300 Mhz to 600 Mhz in 100 Mhz 
performance-level steps. The simulations used a Mandrake 7.2 operating system with 

25 a modified version of the Linux 2.4.4- acl 8 kernel. The workloads used in the 
comparative evaluation were as follows: Plaympeg SDL MPEG player library; 
Acrobat Reader for rendering PDF files; Emacs for text editing; Netscape Mail and 
News 4.7 for news reading; Konqueror 1.9.8 for web browsing; and Xwelltris 1.0.0 as 
a 3D game. The benchmark used for interactive shell commands was a record of a 

30 user performing miscellaneous shell operations during a span of about 30 minutes. To 
avoid possible variability due to the dynamic translation engine of the Crusoe 
processor, most benchmarks were run at least twice to warm up the dynamic 
translation cache, simulation data from all but the last run was disregarded. 
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The performance-setting algorithm according to the present technique has been 
designed so that it is unobtrusive to its host platform is the way timers are handled. 
For the purpose of the simulations the present technique provided a sub-millisecond 
resolution timer, without changing the way in which the Linux built-in 10ms 
resolution timer worked. This was accomplished by piggybacking a timer dispatch 
routine (which checks for timer events) onto often executed parts of the kernel, such 
as the scheduler and system calls. 

Since the performance-setting algorithm according to the present technique is 
designed such that it has hooks to the kernel that allow it to intercept certain system 
calls to find interactive episodes and it is invoked on every task switch, it was straight- 
forward to add a few instructions to these hooks to manage timer dispatches. Each 
hook was augmented by implementing a read of the timestamp counter, a comparison 
against the time stamp of the next timer event and a branch to the timer dispatch 
routine upon success. In practice it was found that this strategy yielded a timer with 
sub-millisecond accuracy. 

Table 2 below details the timer statistics pertaining to the simulations. The 
worst-case timer resolution was bounded by the 10 millisecond (seems to be 
inconsistent with Table 2) time quantum of the scheduler. However, since the events 
that the performance-setting algorithm according to the present technique is interested 
in measuring usually occur close to the timer triggers, the achieved resolution was 
considered to be adequate. It proved to be advantageous that the soft-timers of the 
system stopped ticking when the processor was in sleep mode since this meant that the 
timer interrupts did not change the sleep characteristics of the running operating 
system and program applications. The timers used had high resolution but low 
overhead. 

These advantageous features of the timers facilitated development of an 
implementation having both an active mode and a passive mode. In the active mode 
the performance-setting algorithm according to the present technique was in control. 
In the passive mode the built-in LongRun power manager was in charge of 
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performance although the intelligent energy manager of the present technique acted as 
an observer of the execution and performance changes. 



5 Table 2 



Cost of an access to a timestamp 
counter 


30 to 40 cycles 


Mean interval between timer checks 


— 0.1 milliseconds 


Timer accuracy 


~ 1 millisecond 


Average timer check and dispatch 
duration (including possible execution 
of an event handler) 


100 to 150 cycles 



Monitoring the performance changes caused by LongRun was accomplished similarly 
to the timer dispatch routine. The intelligent energy manager 120 according to the 
present technique periodically read the performance level of the processor through a 

10 machine-specific register and compared the result to a previous value. If the two 
values were different, then the change was logged in a buffer. The intelligent energy 
manager according to the present technique includes a tracing mechanism that retains 
a log of significant events in a kernel buffer. This log includes performance-level 
requests from the different policies, task pre-emptions, task IDs (identifiers), and the 

15 performance levels of the processor. In performing the simulations it was possible to 
compare LongRun and the performance-setting algorithm according to the present 
technique during the same execution run: LongRun was is in control performance- 
setting while the intelligent energy manager 120 of the present technique was 
operable to output the decisions that it would have made on the same workload, had it 

20 been in control. This simulation strategy was used to objectively assess the 

differences between unrepeatable runs of interactive benchmarks between the known 
LongRun technique and the present technique. 

In order to assess the overhead of using the measurement and performance- 
25 setting techniques, the performance-setting algorithm according to the present 
technique was instrumented with markers that kept track of the time spent in the 
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performance-setting algorithm code at run-time. Although the run-time overhead of 
the present technique on a Pentium II was found to be around 0.1% to 0.5%, on the 
Transmeta Crusoe processor the overhead was between 1% and 4%. Further 
measurements in virtual machines such as 'VMWare' and 'user-mode-linux' (UML) 
confirmed that the overhead of the performance-setting algorithms according to the 
present technique can be significantly higher in virtual machines than on traditional 
processor architectures. However this overhead could be effectively reduced by 
algorithm optimisation. 

MPEG (Motion Pictures Expert Group) video playback posed a difficult 
challenge for all of the tested performance-setting algorithms. Although the 
performance-setting algorithms typically put a periodic load on the system, the 
performance requirements can vary depending on the MPEG frame-type. As a 
consequence, if a performance-setting algorithm uses a comparatively long time- 
window corresponding to past (highly variable) MPEG frame-decoding events to 
predict future performance requirements, it can miss the execution deadlines for (less- 
representative) more computationally intensive frames. On the other hand, if the 
algorithm looks at only a short interval, then it will not converge to a single 
performance value but oscillate rapidly between multiple settings. Since each change 
in performance-level incurs a transition delay, rapid oscillation between different 
performance-levels is undesirable. The simulation results for LongRun confirm this 
oscillatory behaviour for the MPEG benchmark. 

The present technique deals with this problem of oscillation for the MPEG 
workload by relying on the interactive performance-setting algorithm at the top level 
of the hierarchy to bound worst-case responsiveness. The more conventional interval- 
based perspectives algorithm at the bottom level of the hierarchy is thus able to take a 
longer-term view of performance-level requirements. 

Figure 8 is a table that details simulation measurement results for the 
'plaympeg' video player (http://www.lokigames.com/development/smpeg.php3) 
playing a variety of MPEG videos. Some of the internal variables of the video player 
have been exposed to provide information about how the player is affected as the 
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result of dynamically changing the processor performance-level during execution. 
These figures are shown in the MPEG decode column of the table. In particular, the 
'Ahead' variable measures how close to the deadline each frame decoding comes. 
The closeness to the deadline is expressed as cumulative seconds during the playback 
of each video. For maximum power efficiency, the Ahead variable value should be as 
close to zero as possible, although the slowest performance level of the processor puts 
a lower limit how much the Ahead value can be reduced. An 'Exactly on time field' 
in the right-most column of the table specifies the total number of frames that met 
their deadlines exactly. The more frames that are exactly on time, the closer the 
performance-setting algorithm is to the theoretical optimum. The data in the 
Execution Statistics column of the table of Figure 8 was collected by the intelligent 
energy manager 120 monitoring sub-system. To collect information about LongRun, 
the intelligent energy manager 120 was used in passive mode to gather a trace of 
performance changes without controlling the processor performance level. The Idle 
field specifies the fraction of time spent in the idle loop of the kernel (possibly doing 
housekeeping chores or just spinning) whereas the Sleep field specifies the fraction of 
time that the processor actually spends in a low-power sleep mode. It can be seen 
from the table in Figure 8 that for each of these performance measures the present 
technique performs considerably better than LongRun. 

Figure 9 is a table that lists processor performance level statistics collected 
during the runs of each workload. The fraction of time at each performance level is 
computed as a proportion of the total non-idle time during the run of the workload. 
The c Mean perf level column of the table specifies the average performance levels 
(as the percentage of peak performance) during the execution of each workload. 
Since, in all cases, the mean performance level for each workload was lower using the 
present technique than for LongRun, the last column specifies the mean performance 
reduction achieved with regard to LongRun. The playback quality for both the 
LongRun workload and the workload of the present technique was the same i.e. 
identical frame rates and no dropped frames. 

The results show that the present technique is more accurately able to predict 
the necessary performance level than the known LongRun technique. The increased 
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accuracy results in an 1 1% to 35% reduction of the average performance levels of the 
processor during execution of the benchmarks. Since the amount of work between 
runs of a workload should stay the same, the lower average performance level implied 
that reduced idle and sleep times could be expected when the intelligent energy 
manager of the present technique is enabled. This expectation was affirmed by the 
simulation results. Similarly, the number of frames that exactly meet their deadlines 
increases when the intelligent energy manager of the present technique is enabled and 
the cumulative amount of time when decode is ahead of its deadline is reduced. 

The median performance level (highlighted with bold in each column of the 
table of Figure 9) also shows significant reductions. Whereas on most benchmarks 
the performance-setting algorithm according to the present technique settles on a 
single performance level below peak for the greatest fraction of execution time 
(>88%), LongRun usually sets the processor to run at full-speed. The exception to 
this general rule is the 'Danse De Cable' workload, where the performance-setting 
algorithm according to the present technique settles on the lowest two performance 
levels and oscillates between these two levels. The reason for this oscillatory 
behaviour is due to the specific performance levels on the Crusoe processor. The 
performance-setting algorithm according to the present technique would have elected 
to select a performance level of only slightly higher than 300 Mhz so that as the 
performance-level prediction fluctuated above and below the 300 MHz value, the 
target performance-level was quantized to the closest two performance levels. The 
most notable difference in performance between the known LongRun technique and 
the present technique is that LongRun appears to be over-cautious in that it ramps up 
the performance level very quickly when it detects significant amounts of processor 
activity. 

Over all workloads, the average processor performance level with LongRun 
never fell below 80%, whilst the performance level set by the present technique fell to 
as low as 52% for the 'Red's Nightmare small' benchmark. The algorithm according 
to the present technique is more aggressive than LongRun but responds quickly when 
the quality of service appears to have been compromised. Since LongRun does not 
have any information about the interactive performance, it is forced to act 
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conservatively on a shorter time frame and the simulation results show that this leads 
to inefficiencies. 

Figure 10 comprises two graphs of results for playback of two different 
MPEG movies entitled 'Legendary' (Figure 10A) and 'Danse de Cable' (Figure 10 B). 
Each graph illustrates the fraction of time spent at each of four processor performance 
levels (300, 400, 500, and 600 MHz) for both LongRun and the present technique. 
Although the playback quality of for each run was identical, it can be seen from the 
graphs that use of the algorithm according to the present technique meant that the 
processor spent significantly longer at below peak performance than it did when the 
LongRun technique specified the performance level. The results for playback of the 
'Legendary' movie plotted in Figure 10A show that the algorithm according to the 
present technique settles on a performance level of 500 MHz. The results for the 
'Danse de Cable' movie shown in Figure 10B reveal that using the algorithm 
according to the present technique, the processor switched between two performance- 
levels i.e. 300 MHz and 400 MHz. By way of contrast, for both of these movies the 
LongRun performance setting algorithm chose the peak processor speed of 600 MHz 
for a dominant portion of the execution time. 

Figure 1 1 provides qualitative insight into the characteristics of the two 
different performance-setting policies. LongRun keeps switching the performance 
level up and down in fast succession, while the processor performance-level of the 
system when controlled according to the present technique stays close to a target 
performance level. The two graphs of Figure 1 1 A (top row) show the performance 
levels of the processor during a benchmark run with LongRun enabled. Figures 1 IB 
and 11C (middle and bottom rows) show performance-level results for the same 
benchmark but with the algorithm of the present technique enabled. Figure 1 IB 
shows the actual performance levels during execution, while Figure 1 1C reflects the 
performance level that the performance-setting algorithm according to the present 
technique would request on a processor that could run at arbitrary performance levels 
(given the same max. performance). Note that in some cases, the desired performance 
levels calculated by algorithm according to the present technique the are actually 
below the minimum achievable performance-level on the processor. 



DY0" ~'f: P15674GBZ 
AR}.. -f: P263 



31 



Now consider simulation results for comparison of the two techniques on 
interactive workloads. Due to the difficulty in making interactive benchmark runs 
repeatable, interactive workloads are significantly harder to evaluate than the 
multimedia benchmarks. To circumvent this problem, empirical measurements were 
combined with a simple simulation technique. More specifically, the interactive 
benchmarks were run under the control of the native LongRun power manager and the 
intelligent energy manager 120 according to the present technique was only engaged 
in passive mode, so that it merely recorded the performance-setting decisions that it 
would have made but did not actually change the performance levels of the processor. 

Figure 12 shows the performance data that was collected during a simulation 
run for assessment of interactive workloads. Figure 12A is a graph of percentage 
performance level against time (in seconds) for the LongRun technique and in this 
case the plotted results correspond to the actual performance levels of the processor 
during the measurement. Figure 12B is a plot of the quantized performance levels 
whereas Figure 12C is a plot of the raw performance levels as a function of time that 
the performance-setting algorithm of the present technique would have set, had it been 
in control of the processor. Note that if the algorithm of the present technique had in 
fact been in control, its performance-setting decisions would have had a different run- 
time impact from those made by LongRun. For this reason the time axes on the 
graphs of Figures 12B and 12C should be regarded as approximations. 

To get around the time-skew problem in the statistics, the passive 
performance-level traces of the simulations according to the present technique were 
post-processed to assess the impact of the increased execution times that would have 
resulted from the use of the present technique instead of LongRun. Rather than 
looking at the entire performance-level trace, only on the interactive episodes were 
focussed on. The interactive performance-setting algorithm of the present technique, 
it includes functionality for finding durations of execution that have a direct impact on 
the user. This technique gives valid readings regardless of which algorithm is in 
control and was thus used to focus our measurements. Once the execution range for 
an interactive episode had been isolated, the full-speed equivalent work done during 
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the episode was computed for both LongRun and the present technique. Since during 
the measurement LongRun is in control of the CPU speed and it runs faster than it 
would do if the resent technique were in control, the episode duration of results 
corresponding to the present technique must be lengthened. First, the remaining work 
5 is computed for the present technique according to the following formula: 

Workpresent technique Remaining " 

= WorkLongRun -Work PreS ent technique 

Next, the algorithm computed to what extent the length of the interactive 
episode needed to be stretched — assuming that the algorithm of the present technique 

10 continued to run at its predicted speed until it reached the panic threshold, at ran at 
full-speed after that. The statistics were adjusted accordingly. It was found that the 
results using this technique were close to what we observed on similar workloads 
(same benchmark but with a slightly different interactive load) running with the 
algorithm according to the present technique in active control of the processor. 

15 However, when the algorithm according to the present technique was actually in 
control, the number of performance-setting decisions was reduced and the 
performance-levels were more accurate. 

Figure 13 shows the statistics gathered using the above-described time-skew 
20 correction technique. Each of the six graphs in the figure graph comprises two stacked 
columns. The left-hand column on each graph relates to LongRun whereas the right- 
hand column relates to the present technique. Each column is stacked so as to 
represent the fraction of time spent in interactive episodes at each of the four 
performance levels supported in the computer. These performance levels — from 
25 bottom up — are from 300 Mhz to 600 Mhz at 100 Mhz increments. Even from a high 
level, it is apparent that the algorithm according to the present technique spends more 
time at lower performance levels than LongRun does. On some benchmarks such as 
Emacs, there is hardly ever a need to go fast and the interactive deadlines are met 
while the machine stays at its lowest possible performance level. At the other end of 
30 the spectrum is the Acrobat Reader benchmark, which exhibits bimodal behaviour: 
the processor either runs at its peak level or at its minimum. Even on this benchmark 
many of the interactive episodes can complete in time at the minimum performance 
level of the processor. However, when it comes to rendering the pages, the peak 
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performance level of the processor is not sufficient to complete its deadlines within 
the user perception threshold. Thus, upon encountering a sufficiently long interactive 
episode, the algorithm according to the present technique switches the processor 
performance-level to its peak. By way of contrast, during the run of the Konqueror 
benchmark, the algorithm according to the present technique can take advantage of all 
four available performance levels of the processor. This can be compared with the 
LongRun strategy, which causes the processor to spend most of its time at the peak 
level. 

Overall, the simulation results detailed above with reference to Figures 8 to 13, 
have shown how two performance-setting policies implemented at different levels in 
the software hierarchy behave on a variety of multimedia and interactive workloads. 
It was found that the Transmeta LongRun power manager, which is implemented in 
the processor's firmware, makes more conservative choices than the algorithm 
according to the present technique, which is implemented in the kernel of the 
operating system. On a set of multi-media benchmarks an 1 1% to 35% average 
performance level reduction was achieved by the algorithm according to the present 
technique over that achieved using the known LongRun technique. 

Since the performance-setting algorithm according to the present technique is 
implemented higher in the software stack than LongRun it is able to make decisions 
based on a richer set of run-time information, which in turn translates into increased 
accuracy. 

Although the firmware approach of LongRun was shown to be less accurate 
than an algorithm implemented in the kernel, it does not diminish its usefulness. 
LongRun has the crucial advantage of being operating system agnostic. It is 
recognised that the gap between low and high level implementations could be bridged 
by to providing a baseline performance-setting algorithm such as LongRun in 
firmware and exposing an interface to the operating system for the purpose of 
(optionally) refining processor performance-setting decisions. The hierarchy of 
performance-setting algorithms according to the present technique provides a 
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mechanism to support such design. The bottom-most performance-setting policy on 
the stack could actually be implemented in the firmware of the processor. 
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CLAIMS 

1 A method of calculating a target processor performance level of a processor 
5 from a utilisation history of said processor in performance of a plurality of processing 
tasks, said method comprising the steps of: 

calculating a task work value indicating processor utilisation in performing a 
given processing task within a predetermined task time-interval; and 

calculating said target processor performance level in dependence upon said 
10 task work value. 

2. A method as claimed in claim 1 , comprising calculating a plurality of task 
work values corresponding to a respective plurality of previous executions of said 
given processing task and combining said plurality of task work values to calculate 
15 said target processor performance level for a future execution of said given processing 
task. 

3 A method as claimed in claim 2, wherein said predetermined task time-interval 
is independently set for each of said plurality of processing tasks. 

20 

4. A method as claimed in claim 3, wherein said predetermined task time-interval 
is independently set for each execution of said given processing task. 

5. A method as claimed in claim 4, wherein said predetermined task time-interval 
25 is a time period extending from the start of a first scheduling of said given processing 

task to the start of a subsequent scheduling of said given processing task, said 
predetermined task time-interval being associated with said first scheduling. 

6. A method as claimed in any one of claims 2 to 5, wherein said plurality of task 
30 work values corresponding to previous executions of said given processing task are 

combined to calculate an exponentially decaying average work done value for said 
given processing task. 
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7. A method as claimed any one of the preceding claims, comprising detecting an 
idle time duration value within said predetermined task time-interval and calculating a 
task execution deadline for said given processing task in dependence upon said task 
work value and said idle time duration. 

5 

8. A method as claimed in claim 7, wherein said task execution deadline is 
calculated for each of a plurality of previous executions of said given processing task 
and the plurality of task execution deadlines are combined to calculate an 
exponentially decaying average task execution deadline value. 

10 

9. A method as claimed in claim 7, wherein said target processor performance 
level for said given processing task is calculated in dependence upon said 
exponentially decaying average work done value and said exponentially decaying 
average task execution deadline value corresponding to said given processing task. 

15 

10. A method as claimed in any one of the preceding claims, further comprising 
the steps of: 

detecting at least one suspended execution period during processing of said 
given processing task, said at least one suspended execution period representing a 
20 time period during which processing is switched from said given processing task to a 
further, different processing task prior to completion of said first task; and 

calculating said task work value for said given processing task such that it 
includes processor utilisation during said at least one suspended execution period. 

25 11. A method as claimed in claim 1 0, comprising setting an upper threshold for 
said predetermined task time-interval such that if said given processing task continues 
to execute without detection of said suspended execution period for a duration greater 
than or equal to said upper threshold, said target processor performance level for said 
task is automatically recalculated. 

30 

12. A method according to any one of the above claims, wherein a flag value is 
stored for each task, said flag value indicating if the corresponding task has started to 
execute but has not yet completed execution. 
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13. A method as claimed in any one of claims 2 to 12, wherein each task work 
value for a respective previous execution of said given processing task is normalised 
by a corresponding predetermined task time-interval when combining said task work 

5 values to calculate said target processor performance level for said future execution of 
said task. 

14. A computer program product bearing a computer program for controlling a 
computer to calculate a target processor performance level of a processor from a 

1 o utilisation history of said processor in performance of a plurality of processing tasks, 

said computer program comprising: 

task work value calculating code operable to calculate a task work value 

indicating processor utilisation in performing a given processing task within a 

predetermined task time-interval; and 
15 target processor performance calculating code operable to calculate said target 

processor performance level in dependence upon said task work value. 

15. A computer program product as claimed in claim 14, wherein said task work 
calculating code calculates a plurality of task work values corresponding to a 

20 respective plurality of previous executions of said given processing task and 
combining said plurality of task work values to calculate said target processor 
performance level for a future execution of said given processing task. 

16. A computer program product as claimed in claim 15, wherein said 

25 predetermined task time-interval is independently set for each of said plurality of 
processing tasks. 

17. A computer program product as claimed in claim 16, wherein said 
predetermined task time-interval is independently set for each execution of said given 

30 processing task. 

18. A computer program product as claimed in claim 17, wherein said 
predetermined task time-interval is a time period extending from the start of a first 
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scheduling of said given processing task to the start of a subsequent scheduling of said 
given processing task, said predetermined task time-interval being associated with 
said first scheduling. 

5 19. A computer program product as claimed in any one of claims 1 5 to 18, 

wherein said plurality of task work values corresponding to previous executions of 
said given processing task are combined to calculate an exponentially decaying 
average work done value for said given processing task. 

10 20. A computer program product as claimed any one of claims 14 to 19, 

comprising detecting code operable to detecting an idle time duration value within 
said predetermined task time-interval and calculating a task execution deadline for 
said given processing task in dependence upon said task work value and said idle time 
duration. 

15 

21 . A computer program product as claimed in claim 20, wherein said task 
execution deadline is calculated for each of a plurality of previous executions of said 
given processing task and the plurality of task execution deadlines are combined to 
calculate an exponentially decaying average task execution deadline value. 

20 

22. A computer program product as claimed in claim 20, wherein said target 
processor performance level for said given processing task is calculated in 
dependence upon said exponentially decaying average work done value and said 
exponentially decaying average task execution deadline value corresponding to said 

25 given processing task. 

23. A computer program product as claimed in any one of claims 14 to 22, further 
comprising: 

suspended execution period detecting code operable to detect at least one 
30 suspended execution period during processing of said given processing task, said at 
least one suspended execution period representing a time period during which 
processing is switched from said given processing task to a further, different 
processing task prior to completion of said first task; and 



10 
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wherein said task work value calculating code is operable to calculate said task 
work value for said given processing task such that it includes processor utilisation 
during said at least one suspended execution period. 

24. A computer program product as claimed in claim 23, wherein an upper 
threshold for said predetermined task time-interval is set such that if said given 
processing task continues to execute without detection of said suspended execution 
period for a duration greater than or equal to said upper threshold, said target 
processor performance level for said task is automatically recalculated. 

25 . A computer program product according to any one of claims 1 4 to 24, wherein 
a flag value is stored for each task, said flag value indicating if the corresponding task 
has started to execute but has not yet completed execution. 

15 26. A computer program product as claimed in any one of claims 15 to 25, 
wherein each task work value for a respective previous execution of said given 
processing task is normalised by a corresponding predetermined task time-interval 
when combining said task work values to calculate said target processor performance 
level for said future execution of said task. 

20 

21. Apparatus for calculating a target processor performance level of a processor 
from a utilisation history of said processor in performance of a plurality of processing 
tasks, said apparatus comprising: 

task work value calculating logic operable to calculate a task work value 
25 indicating processor utilisation in performing a given processing task within a 
predetermined task time-interval; and 

target processor performance calculating logic operable to calculate said target 
processor performance level in dependence upon said task work value. 



30 



28. Apparatus as claimed in claim 27, wherein said task work calculating logic 
calculates a plurality of task work values corresponding to a respective plurality of 
previous executions of said given processing task and combining said plurality of task 
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work values to calculate said target processor performance level for a future execution 
of said given processing task. 

29. Apparatus as claimed in claim 28, wherein said predetermined task time- 
5 interval is independently set for each of said plurality of processing tasks. 

30. Apparatus as claimed in claim 29, wherein said predetermined task time- 
interval is independently set for each execution of said given processing task. 

10 31. Apparatus as claimed in claim 30, wherein said predetermined task time- 
interval is a time period extending from the start of a first scheduling of said given 
processing task to the start of a subsequent scheduling of said given processing task, 
said predetermined task time-interval being associated with said first scheduling. 

15 32. Apparatus as claimed in any one of claims 28 to 3 1 , wherein said plurality of 
task work values corresponding to previous executions of said given processing task 
are combined to calculate an exponentially decaying average work done value for said 
given processing task. 

20 33. Apparatus as claimed any one of claims 28 to 32, comprising detecting logic 
operable to detecting an idle time duration value within said predetermined task time- 
interval and calculating a task execution deadline for said given processing task in 
dependence upon said task work value and said idle time duration. 

25 34. Apparatus as claimed in claim 33, wherein said task execution deadline is 

calculated for each of a plurality of previous executions of said given processing task 
and the plurality of task execution deadlines are combined to calculate an 
exponentially decaying average task execution deadline value. 

30 35. Apparatus as claimed in claim 33, wherein said target processor performance 
level for said given processing task is calculated in dependence upon said 
exponentially decaying average work done value and said exponentially decaying 
average task execution deadline value corresponding to said given processing task. 
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36. Apparatus as claimed in any one of claims 28 to 35, further comprising: 
suspended execution period detecting logic operable to detect at least one 

suspended execution period during processing of said given processing task, said at 
5 least one suspended execution period representing a time period during which 

processing is switched from said given processing task to a further, different 

processing task prior to completion of said first task; and 

wherein said task work value calculating logic is operable to calculate said 

task work value for said given processing task such that it includes processor 
10 utilisation during said at least one suspended execution period. 

37. Apparatus as claimed in claim 36, wherein an upper threshold for said 
predetermined task time-interval is set such that if said given processing task 
continues to execute without detection of said suspended execution period for a 

15 duration greater than or equal to said upper threshold, said target processor 
performance level for said task is automatically recalculated. 

38. Apparatus according to any one of claims 28 to 37, wherein a flag value is 
stored for each task, said flag value indicating if the corresponding task has started to 

20 execute but has not yet completed execution. 

39. Apparatus as claimed in any one of claims 28 to 3 8, wherein each task work 
value for a respective previous execution of said given processing task is normalised 
by a corresponding predetermined task time-interval when combining said task work 

25 values to calculate said target processor performance level for said future execution of 
said task. 
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ABSTRACT 
DATA PROCESSING SYSTEM 

A target processor performance level is calculated from a utilisation 
5 history of a processor in performance of a plurality of processing tasks. The method 
comprises calculating a task work value indicating processor utilisation in performing 
a given processing task within a predetermined task time-interval and calculating a 
target processor performance level in dependence upon the task work value. 
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[Figure 1] 
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